Exploratory Data Analysis

Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
25/10/10 18:30:16 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[Stage 0:>                                                          (0 + 1) / 1]                                                                                [Stage 1:>                                                          (0 + 1) / 1]                                                                                25/10/10 18:30:28 WARN SparkStringUtils: Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.sql.debug.maxToStringFields'.

+---------------------+-------------------+--------------------+--------------------+---------+-----------+--------+-------------------+--------------------+----------+--------------------+--------------------+--------------------+--------------------+--------------------+--------------------+-----------------------+-------------------+------------------+--------------------+--------------------+--------------------+--------------------+-------------------------------+-------------------------+----------------------------------+----------------------+----------------------------+-----------------------+--------------------+--------------------+---------------+---------------+------------+------------------+-----------+---------------+
|EDUCATION_LEVELS_NAME| MIN_EDULEVELS_NAME|EMPLOYMENT_TYPE_NAME|MIN_YEARS_EXPERIENCE|SALARY_TO|SALARY_FROM|  SALARY|          CITY_NAME|            MSA_NAME|STATE_NAME|         NAICS2_NAME|         NAICS3_NAME|         NAICS4_NAME|         NAICS5_NAME|         NAICS6_NAME|         SKILLS_NAME|SPECIALIZED_SKILLS_NAME|CERTIFICATIONS_NAME|COMMON_SKILLS_NAME|SOFTWARE_SKILLS_NAME|           ONET_NAME|LOT_CAREER_AREA_NAME| LOT_OCCUPATION_NAME|LOT_SPECIALIZED_OCCUPATION_NAME|LOT_OCCUPATION_GROUP_NAME|LOT_V6_SPECIALIZED_OCCUPATION_NAME|LOT_V6_OCCUPATION_NAME|LOT_V6_OCCUPATION_GROUP_NAME|LOT_V6_CAREER_AREA_NAME|          SOC_2_NAME|          SOC_3_NAME|     SOC_4_NAME|     SOC_5_NAME|REMOTE_GROUP|STATE_ABBREVIATION|AFFILIATION|MIDPOINT_SALARY|
+---------------------+-------------------+--------------------+--------------------+---------+-----------+--------+-------------------+--------------------+----------+--------------------+--------------------+--------------------+--------------------+--------------------+--------------------+-----------------------+-------------------+------------------+--------------------+--------------------+--------------------+--------------------+-------------------------------+-------------------------+----------------------------------+----------------------+----------------------------+-----------------------+--------------------+--------------------+---------------+---------------+------------+------------------+-----------+---------------+
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
|  No Education Listed|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|            Unknown|             Unknown|   Unknown|             Unknown|             Unknown|             Unknown|             Unknown|             Unknown|                NULL|                   NULL|               NULL|              NULL|                NULL|                NULL|                NULL|                NULL|                           NULL|                     NULL|                              NULL|                  NULL|                        NULL|                   NULL|                NULL|                NULL|           NULL|           NULL|      Onsite|           Unknown|       NULL|       108668.5|
| [  "No Education ...|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0| [Unknown City], UT|             Unknown|      Utah|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|    [  "Positivity"]|                     []|                 []|  [  "Positivity"]|                  []|Business Intellig...|Information Techn...|Business Intellig...|           Oracle Consultant...|     Business Intellig...|              Oracle Consultant...|  Business Intellig...|        Business Intellig...|   Information Techn...|Computer and Math...|Mathematical Scie...|Data Scientists|Data Scientists|      Onsite|                UT|        Red|       108668.5|
| [  "No Education ...|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0| [Unknown City], TX|             Unknown|     Texas|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|[  "SAP Logistics...|   [  "SAP Logistics...|                 []|                []|[  "SAP Logistics...|Business Intellig...|Information Techn...|Business Intellig...|            SAP Analyst / Admin|     Business Intellig...|               SAP Analyst / Admin|  Business Intellig...|        Business Intellig...|   Information Techn...|Computer and Math...|Mathematical Scie...|Data Scientists|Data Scientists|      Onsite|                TX|        Red|       108668.5|
| [  "No Education ...|No Education Listed|           Full-Time|                 0.0|  52000.0|    39000.0| 45500.0|          Miami, FL|Miami-Fort Lauder...|   Florida|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|                  []|                     []|                 []|                []|                  []|Business Intellig...|Business Manageme...|Business / Manage...|           Business Analyst ...|        Business Analysis|              Business Analyst ...|  Business / Manage...|           Business Analysis|   Business Manageme...|Computer and Math...|Mathematical Scie...|Data Scientists|Data Scientists|      Onsite|                FL|        Red|        45500.0|
| [  "No Education ...|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|    Los Fresnos, TX|Brownsville-Harli...|     Texas|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|                  []|                     []|                 []|                []|                  []|Business Intellig...|Business Manageme...|Business / Manage...|           Business Analyst ...|        Business Analysis|              Business Analyst ...|  Business / Manage...|           Business Analysis|   Business Manageme...|Computer and Math...|Mathematical Scie...|Data Scientists|Data Scientists|      Onsite|                TX|        Red|       108668.5|
| [  "No Education ...|No Education Listed|           Full-Time|                 0.0| 130042.0|    87295.0|115024.0|Fort Lauderdale, FL|Miami-Fort Lauder...|   Florida|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|Unclassified Indu...|   [  "Landscaping"]|      [  "Landscaping"]|                 []|                []|                  []|Business Intellig...|Business Manageme...|Business / Manage...|           Business Analyst ...|        Business Analysis|              Business Analyst ...|  Business / Manage...|           Business Analysis|   Business Manageme...|Computer and Math...|Mathematical Scie...|Data Scientists|Data Scientists|      Onsite|                FL|        Red|       108668.5|
+---------------------+-------------------+--------------------+--------------------+---------+-----------+--------+-------------------+--------------------+----------+--------------------+--------------------+--------------------+--------------------+--------------------+--------------------+-----------------------+-------------------+------------------+--------------------+--------------------+--------------------+--------------------+-------------------------------+-------------------------+----------------------------------+----------------------+----------------------------+-----------------------+--------------------+--------------------+---------------+---------------+------------+------------------+-----------+---------------+
only showing top 15 rows

Exploring the Salary by State Political Affiliation

[Stage 3:>                                                          (0 + 1) / 1]                                                                                

This data clearly shows that average salaries are slightly higher in Blue states vs Red States across nearly all NAICS2 categories. Professional, Scientific, and Technical Services appears to be about equal regardless of affiliation.

Exploring the minimum education level by political affiliation

[Stage 11:>                                                         (0 + 1) / 1]                                                                                

+-----------+--------------------+-----+------------------+
|AFFILIATION|  MIN_EDULEVELS_NAME|count|        avg_salary|
+-----------+--------------------+-----+------------------+
|       Blue|Ph.D. or professi...|   65|121177.26153846153|
|       Blue|     Master's degree|  975|127811.44102564102|
|        Red|Ph.D. or professi...|   45|101607.06666666667|
|       Blue| No Education Listed|10313|117231.11810336469|
|       Blue|    Associate degree| 1058|116931.42722117202|
|        Red|  High school or GED| 1992|  97134.2093373494|
|       Blue|  High school or GED| 1563| 99052.77095329495|
|       Blue|   Bachelor's degree|18247|118800.53685537349|
|        Red|   Bachelor's degree|21201|116179.15782274421|
|        Red| No Education Listed|11088|114194.55952380953|
|        Red|     Master's degree|  720|126568.86388888888|
|        Red|    Associate degree| 1914|116796.46603970742|
+-----------+--------------------+-----+------------------+

[Stage 14:>                                                         (0 + 1) / 1]                                                                                

This graph shows us the comparison of job postings by political affiliation and minimum education level. As you can see, red states have far more job postings for lower education levels such as High School, Associate Degree, or Bachelor’s degree, and blue states have more postings requiring a Master’s Degree or higher.

This figure tells us that despite red states having more job postings with education level requirements below a Master’s degree, the salaries in Blue states are higher for every single minimum education level. This could be attributed to a higher cost of living in most blue states.

AI Jobs Analysis

+-------------------+-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+------------------+-----------+
|MIN_EDULEVELS_NAME |LOT_OCCUPATION_NAME                  |SKILLS_NAME                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |SALARY  |STATE_ABBREVIATION|AFFILIATION|
+-------------------+-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+------------------+-----------+
|No Education Listed|Business Intelligence Analyst        |[  "Artificial Intelligence",  "Angular (Web Framework)",  "ClickUp (Software)",  "Cyber Defense",  "Cyber Security",  "Engineering Management",  "Front End Design",  "Manufacturing Execution System (MES)",  "Operations",  "Project Management",  "SAP Applications",  "Wax"]                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |115024.0|TX                |Red        |
|Bachelor's degree  |Data / Data Mining Analyst           |[  "Chemical Engineering",  "Mechanical Engineering",  "Power BI",  "Forecasting",  "Hydraulics",  "Data Science",  "Data Engineering",  "Spreadsheets",  "Cost Benefit Analysis",  "Communication",  "Python (Programming Language)",  "Oil and Gas",  "Data Analysis",  "Statistical Modeling",  "SQL (Programming Language)",  "Data Modeling",  "Mathematics",  "Data Visualization",  "Computer Science"]                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |140400.0|TX                |Red        |
|No Education Listed|Business / Management Analyst        |[  "Business Communication",  "Data Science",  "Business Concepts",  "Project Management",  "Business Process",  "Communication",  "Time Management",  "Product Management",  "Data Analysis",  "Marketing",  "Stakeholder Management",  "Market Research",  "Business Intelligence",  "Business Operations",  "Cyber Security",  "Organizational Skills",  "Willingness To Learn",  "User Experience (UX)",  "Sales",  "Software Development",  "Problem Solving",  "Teaching",  "Compensation Analysis"]                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |115024.0|IN                |Red        |
|No Education Listed|Data / Data Mining Analyst           |[  "Salesforce",  "Apache Hadoop",  "C++ (Programming Language)",  "Gamification",  "Business Objectives",  "Data Mining",  "Data Processing",  "Collibra (Software)",  "Project Management",  "Finance",  "Algorithms",  "Python (Programming Language)",  "Apache Spark",  "Dashboard",  "Decision Making",  "Wealth Management",  "Machine Learning",  "Predictive Modeling",  "Natural Language Processing (NLP)",  "Microsoft Excel",  "SAS (Software)",  "Data Governance",  "Artificial Intelligence",  "Innovation",  "Data Visualization",  "Tableau (Business Intelligence Software)",  "R (Programming Language)",  "SQL (Programming Language)"]                                                                                                                                                                                                                                                                                                                                                     |115024.0|NY                |Blue       |
|Bachelor's degree  |Data / Data Mining Analyst           |[  "Power BI",  "Programming Languages",  "Customer Experience Improvement",  "Self-Motivation",  "Data Science",  "Linux",  "Python (Programming Language)",  "Sustaining Engineering",  "Data Analysis",  "Program Process Monitoring",  "Java (Programming Language)",  "SQL (Programming Language)",  "Product Engineering",  "Data Collection",  "Design Studio",  "Amazon Web Services",  "Software Development",  "Product Quality (QA/QC)",  "Data Visualization",  "Tableau (Business Intelligence Software)",  "Computer Science"]                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |71458.0 |WI                |Red        |
|Bachelor's degree  |Computer Systems Engineer / Architect|[  "Inventory Staging",  "Relational Databases",  "Computer Engineering",  "Star Schema",  "Information Technology",  "Management",  "Management Information Systems",  "Agile Methodology",  "Process Improvement",  "Application Development",  "Erwin (Data Modeling Software)",  "Data Science",  "Data Warehousing",  "Metadata Management",  "Amazon Redshift",  "Data Architecture",  "Interpersonal Communications",  "Cost Benefit Analysis",  "Waterfall Methodology",  "Aurora (Operating System)",  "Communication",  "Textiles",  "Systems Development Life Cycle",  "Leadership",  "Information Systems",  "Data Quality",  "Data Analysis",  "Business Requirements",  "Extract Transform Load (ETL)",  "SQL (Programming Language)",  "Operational Data Store",  "Data Modeling",  "Machine Learning",  "Third Normal Form",  "Change Management",  "Mentorship",  "Business Administration",  "Document-Oriented Databases",  "Data Strategy",  "Computer Science"]                             |147650.0|SD                |Red        |
|No Education Listed|Business / Management Analyst        |[  "Information Retrieval",  "Research",  "Data Infrastructure",  "Business Analytics",  "Innovation",  "Experimental Design",  "Statistical Analysis",  "Data Mining",  "Automation",  "Data Science",  "Data Engineering",  "Amazon Redshift",  "Data Architecture",  "Timelines",  "Requirements Management",  "Python (Programming Language)",  "Leadership",  "Supply Chain",  "Machine Learning",  "Communication",  "Business Intelligence",  "SQL (Programming Language)",  "Scalability",  "Scripting",  "Amazon Web Services",  "Data Integrity",  "Extract Transform Load (ETL)"]                                                                                                                                                                                                                                                                                                                                                                                                                     |160050.0|WA                |Blue       |
|No Education Listed|Business Intelligence Analyst        |[  "Information Retrieval",  "Inventory Planning",  "Analytical Skills",  "Experimental Design",  "Statistical Analysis",  "Data Mining",  "Self-Motivation",  "Automation",  "Data Science",  "Supply Chain Optimization",  "Business Metrics",  "Data Engineering",  "Supply Chain Acumen",  "Innovation",  "Python (Programming Language)",  "Leadership",  "Data Analysis",  "Machine Learning",  "Communication",  "Business Intelligence",  "Detail Oriented",  "SQL (Programming Language)",  "Scalability",  "Scripting",  "Amazon Web Services",  "Product Description",  "Data Visualization"]                                                                                                                                                                                                                                                                                                                                                                                                         |160050.0|WA                |Blue       |
|Bachelor's degree  |Data / Data Mining Analyst           |[  "Certified Information System Auditor (CISA)",  "Apache Hadoop",  "Prioritization",  "Coaching",  "Planning",  "Certified Fraud Examiner",  "Statistical Analysis",  "Self-Motivation",  "Data Science",  "Finance",  "Certified Analytics Professional",  "Communication",  "Innovation",  "Python (Programming Language)",  "Forensic Sciences",  "Emerging Technologies",  "Decision Making",  "Data Analysis",  "SQL (Programming Language)",  "SAS (Software)",  "Certified Information Systems Security Professional",  "Certified Information Security Manager",  "Scripting",  "Power BI",  "SPSS (Statistical Software)",  "Data Visualization",  "R (Programming Language)"]                                                                                                                                                                                                                                                                                                                        |140300.0|NC                |Red        |
|Bachelor's degree  |Data / Data Mining Analyst           |[  "Workflow Management",  "General Data Protection Regulation (GDPR)",  "Analytic Applications",  "Medical Records",  "Electronic Medical Record",  "Agile Methodology",  "Value-Based Care",  "Health Administration",  "Project Status Reports",  "Data Science",  "Data Management",  "Healthcare Industry Knowledge",  "Big Data",  "Statistical Modeling",  "Informatics",  "Scrum (Software Development)",  "Communication",  "Valid Driver's License",  "Listening Skills",  "Decision Making",  "Data Analysis",  "Customer Data Management",  "Data Cleansing",  "Fast Healthcare Interoperability Resources (FHIR)",  "Business Requirements",  "Investigation",  "Project Management",  "Data Modeling",  "Key Performance Indicators (KPIs)",  "Scalability",  "Technology Solutions",  "Health Insurance Portability And Accountability Act (HIPAA) Compliance",  "ASC X12 Standards",  "Power BI",  "Problem Solving",  "SQL (Programming Language)",  "Tableau (Business Intelligence Software)"]|164600.0|PA                |Red        |
+-------------------+-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+------------------+-----------+
only showing top 10 rows

[Stage 18:>                                                         (0 + 1) / 1]                                                                                

+-----------+--------------------+-----+------------------+
|AFFILIATION|  MIN_EDULEVELS_NAME|count|        avg_salary|
+-----------+--------------------+-----+------------------+
|       Blue|Ph.D. or professi...|   13|114372.30769230769|
|       Blue|     Master's degree|  367| 122253.1553133515|
|        Red|Ph.D. or professi...|   11|105201.45454545454|
|       Blue| No Education Listed|  942|125017.12101910828|
|       Blue|    Associate degree|  203|          133256.0|
|        Red|  High school or GED|  114|104949.07894736843|
|       Blue|  High school or GED|  128|    111645.7265625|
|       Blue|   Bachelor's degree| 3582|121041.59491903965|
|        Red|   Bachelor's degree| 3632|116541.23595814977|
|        Red| No Education Listed|  841|113824.22948870392|
|        Red|     Master's degree|  221|119314.45248868778|
|        Red|    Associate degree|  290|130392.43793103448|
+-----------+--------------------+-----+------------------+

[Stage 21:>                                                         (0 + 1) / 1]                                                                                

This figure shows us the number of postings just with certain key words related to AI. It groups by education level and political affiliation. The graph tells us that the distribution of number of AI job postings across education level and affiliation mirrors that of the larger data set. Thus, AI jobs are not posted at any higher frequency across red or blue states than any other job.

Similarly, in this figure, AI Jobs show salary distributions equivalent to that of jobs in other industries. Like the general analysis, blue states offer higher salaries for AI jobs across each of education levels. Again, this is likely due to the higher cost of living in most blue states.

[Stage 24:>                                                         (0 + 1) / 1]                                                                                

+------------------+-----------+-----+------------------+
|STATE_ABBREVIATION|AFFILIATION|count|avg_salary        |
+------------------+-----------+-----+------------------+
|CA                |Blue       |1058 |130800.25141776938|
|TX                |Red        |1045 |119186.34354066986|
|NY                |Blue       |617  |118399.72609400324|
|VA                |Blue       |598  |116501.39632107023|
|IL                |Blue       |480  |120063.675        |
|FL                |Red        |447  |115597.10514541387|
|GA                |Red        |419  |111773.3723150358 |
|NC                |Red        |372  |117288.66935483871|
|OH                |Red        |362  |114862.99171270718|
|PA                |Red        |338  |118117.09467455621|
+------------------+-----------+-----+------------------+
only showing top 10 rows

[Stage 27:>                                                         (0 + 1) / 1]